General Oracle Inequalities for Gibbs Posterior with Application to Ranking
نویسندگان
چکیده
In this paper, we summarize some recent results in Li et al. (2012), which can be used to extend an important PAC-Bayesian approach, namely the Gibbs posterior, to study the nonadditive ranking risk. The methodology is based on assumption-free risk bounds and nonasymptotic oracle inequalities, which leads to nearly optimal convergence rates and optimal model selection to balance the approximation errors and the stochastic errors.
منابع مشابه
On the properties of variational approximations of Gibbs posteriors
The PAC-Bayesian approach is a powerful set of techniques to derive non-asymptotic risk bounds for random estimators. The corresponding optimal distribution of estimators, usually called the Gibbs posterior, is unfortunately often intractable. One may sample from it using Markov chain Monte Carlo, but this is usually too slow for big datasets. We consider instead variational approximations of t...
متن کاملRatio Limit Theorems for Empirical Processes
Concentration inequalities are used to derive some new inequalities for ratio-type suprema of empirical processes. These general inequalities are used to prove several new limit theorems for ratio-type suprema and to recover a number of the results from [1] and [2]. As a statistical application, an oracle inequality for nonparametric regression is obtained via ratio bounds.
متن کاملNew Jensen and Ostrowski Type Inequalities for General Lebesgue Integral with Applications
Some new inequalities related to Jensen and Ostrowski inequalities for general Lebesgue integral are obtained. Applications for $f$-divergence measure are provided as well.
متن کاملOracle inequalities and the isomorphic method
We use the isomorphic method to study exact and non-exact oracle inequalities for empirical risk minimization in classes of functions that satisfy a subgaussian condition. We show that the “isomorphic profile” of the corresponding squared-loss classes may be characterized using properties of the gaussian process indexed by the underlying base class. We use this information to obtain the oracle ...
متن کاملThermodynamic Inequalities for Percolation
In this paper we describe the percolation analogues of the Gibbs and Helmholtz potentials and use these quantities to prove some general inequalities concerning the critical exponents of percolation processes.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013